Advanced Optimizations for Parallel Irregular Out-of-Core Programs
نویسندگان
چکیده
Large scale irregular applications involve data arrays and other data structures that are too large to t in main memory and hense reside on disks. This paper presents a method for implementing this kind of applications on distributed-memory systems. The method is based on a runtime system that has been built on top of the CHAOS library.
منابع مشابه
Advanced visualization and data distribution steering in an HPF parallelization environment
On distributed-memory systems, the quality of the data distribution has a crucial impact on the eeciency of the computation. Sophisticated visualization of large in-core and out-of-core data, and steering capabilities of the debugging system sig-niicantly reduce program development cycle, especially for irregular applications. In this paper we present an advanced system for visualization and st...
متن کاملData Access Reorganizations in Compiling Out-of-Core Data Parallel Programs on Distributed Memory Machines
This paper describes optimization techniques for translating out-of-core programs written in a data parallel language like HPF to message passing node programs with explicit parallel I/O. We rst discuss how an out-of-core program can be translated by extending the method used for translating in-core programs. We demonstrate that straightforward extension of in-core compilation techniques does n...
متن کاملGlobal I/O optimizations for out-of-core computations
The use of parallel machines to solve large scale computational problems in science and engineering has increased considerably in recent times. Many of these problems have computational requirements which stretch the capabilities of even the fastest machine available today. In addition to requiring a great deal of computational power, these problems usually deal with large quantities of data up...
متن کاملPerformance tuning scientific codes for dataflow execution
Performance tuning programs for dataflow execution involves tradeoffs and optimizations which may be significantly different than for execution on conventional machines. We examine some tuning techniques for scientific programs with regular control but irregular geometry. We use as an example the core of an ocean modeling code developed in the implicitly parallel language Id for the Monsoon dat...
متن کاملPassion: Parallel and Scalable Software for Input-output
We are developing a software system called PASSION: Parallel And Scalable Software for InputOutput which provides software support for high performance parallel I/O. PASSION provides support at the language, compiler, runtime as well as le system level. PASSION provides runtime procedures for parallel access to les (read/write), as well as for out-of-core computations. These routines can either...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1996